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ABSTRACT / <. 

/ Four of the policy statements ' for voca^t iona35r 
education dfeve loped by the Wisconsin Board of Vocational,, Technical, 
and Adult Education reflec^t conterns shared" in the U.S. Department 
Education/s Office of Vocational -and Adult Education. Ficst, 
vocational, education is accountable to the publics, namely students, 
employer/4, and state , local , and federal governments . Second, 
evaluation systems for vocational education are the responsibility 'of 
state a'nd'local units. Third, planning and implementation of . 
vocational education programs is carried out by the local district ' - 
with >ihe assistance of appropriate state leadership and federal ^ 
agen'dies. Fourth, state agencies responsible for vocational education . 
prpVicJe leadership for evaluation of vocational education. Evaluating 
vocational programs and measuring their effectiveness is difficult. 
Vocational programs have different pu^rposes and are offered by " ' 
diverse institutions. Four measures to evaluate vocational 
education— components and process, occupationalv impact, equity, and 
individual student development~aiJ-T^eserf4: similar complications. 
Two- issues that will affect vocational programs lare weighting 
evaluation measures and choosing which programs to improve." The 
proposed Vocational and Adult Education Consolidation Act of 1983 has* 
the^se components: a- simplification of- the current\Vocational . 
Education 'Act- and provision for a single consolidated grant to each ^ 
state. (YLB) . 
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.It %s a pleasure to be here with you^n Wisconsin today to discuss with lyou • 
what's ahead 'for evalUatl on --and aglount ability in vocational and adult - \ 
education. * In addition^ I welcome this opportunity to bri^ef you about our . , 
legislation proposal now being considered by the Congress. . . •. 

' ■ ' • ■ ■ ■ 

I' was here in Wisconsin at Wingspread just last^ month to participate in an 

♦ . , ■ ' ■» 

International 'Conference on Technical Educdtion. ; My remarks at that conference 
;dealt with, among other items, exploring ways of creating new and productive^ 
ties between education and the private sector to improve skilled workforce 
developmeHit. Here in Wiscorisln, you have put into 'practice' that >htch 
President Reagan has -urged others to do — forge^ partnerships. The White - 
"House Office of Private Sector Initiatives e^icourages voluntarism and / 
promotes public-private sector partnerships. , 

I'd like to take a'^inute here 'to talk about excellence in light of the 
^•recent report of the National Commission pn Excellence in Education. The 
report" begins, "Our Nation is at risk. once unchallenged preeminence 

in commerce, industry, science, dnd technological innovation is.being over- 
taken Ijy^corapetitors thrbughout the worlS.'^ The report continues .while 
we can take justifiable pride in what our schdols and colleges have historically 
accomplished and contributed to the United States and the wei;-being of its . 
Vpeopl6, the. educational fou^ldation8 of our society are presently being eroded . 
by a rising tide of mediocrity that threatens our vei-y future as a Nation «,and 

a' peoiSle.." ^ ' ' - v - - ^ ' ' i-i ■ ' ^ 

, \ • , ■ . " ■ < 

Certainly the' vocational education entepr'ise can take pride ±ti its 
accomplishments-- but although vocational education was not a specif ic" target 
of the Commissio'n's study, we c&not afford to be complacent. The jobs 
Ameri-cans have are changing--whole new industries are' emerging, and we in 

vocational education must eni/ure that our. programs prepare students for 

• ^ ■ ' ' f ' ■ ■ •■ . ' , , 



the jobs of todajrand tomorrow. Economic suArival and this ..Nation' s capacity 
to become more productive are of paramount importance toXPresident" Reagan' and' 
to all of us. We, in- vocational education/ can contribute to our Nation's 
economic recovery, but riot if our programs are mediocre I Not if our prtJgrams • 
ax^ not responsive to the skilled workforce "demands of aur changing societyl' 
J^s the/cbiranission stated, "Our goal must be ^to develop the talents of all to 

/ • ■ ■ , :. ^ ' . . • ■ • 

their fullest. Attaining that goal requires that we expect and assist all 

..." ■. - ' ■ ■ ■ . ■■ ^ 

stjidentSj to work to the limits of their capabilities." We must work closely 

with> busdnesst industry and lal^br — we^must work together in developing our 

I .. ' . / , ■ * " -- 

most prec^bus reso^^trce- ^the hu^an resource ! 

One program in par4:icular * that comes to mind is the Telephone Service and 

' . . ^ ' ^ r ' 

Rep^iy Program at Wisconsin Indianhead Technical Institute. As you know, t 

' I ' ^ * ^ 

in 1982, this program received the Secretary's Award for Outstanding 

Vocational Education programs. This program, to prepare students fo'^jgTbs in. 

installation, inainteriance, and refjair in the telephone industry, is an* example . 

" v' f ^ - ■ 

of what vocational education programs c^n ahd should be. Part of the r^^an 

for the excellence of this program is its evaluation component. The In-dianhead 

"■■ ^ ^ 

'Distri^ct and the State conduct evaluations , ^he North Central Accreditation 

■ - ■ « [■ ' ■ 

process involves eva^?^atlons, -and' a continuous evaluation of curriculum a^d 



instructional upgradingvls maintained by, an industry appointed advisory 
committee. Evaluaticfns and evaluation concerns are not new for Wisconsin; 
they are an .integral part of your education process and certainly tpredate 

our current -Itodational Education legislation. I 

* , ' - 

In 1977, the Wisconsin Board of Vocationa,l, Technical, arid Adult Education 

published a document entitled '-^Policy Statements for Vocational Education in , 

^ . . , 

Wisconsin." ^Receptly, I reread Ithi^ pijDlicatioi;^ to review what your Boajrd 

. ■ * •( ' ^ . ■ • - . . 

• ^' . • 

.. ■ • t - 



■ • ' ' ■ • . ■ : -3- ■ r 

' ■ * / • , ■ ' • . i ■ ^ • • ' ■ ■ " ' I '■• ■ ■. . 

had said. It is not unexpected .that the concerns and approaches that your * * 
Wisconsin Board expressed are very similar tp the concerns and approaches • 
that Wje have iil the Education Department. • i; 

I have s&lected four of these policy statements to discuss here because 
they reflect current concerns tfiat are shared in th^ Office of ^Vocational 

and Adult Education and in the rest of the Education Department. (1) ThW^ 

> . .. 

first policy statement is "Vocational Education shall be/held accountable 

* * ■ ' . ,? 

to the various publics for the attainments of its goals-and objectives.)^ 

To wl\om — to the publics — is vocational Education atcountabXe? . ,I^6cal vocational 

^ . . . . • ' • i • •: 

education agencies aire accountable to the State Bpard^tf But bo^h State and 
local agencies are primarily accountable to students. Our etrtite vocational 
education sylstem exists to meet the needs pf our vocational education students. 
Vocational education is also accountable to private businesi^' and industri^j^ 



who hire biir graduates. The presence of vocational programs often persuades 
an employer to locate in a given community. We have an obligation to continue 
to prepare our students for employment in these cbmpapies. • ^ • * 

. - ;/ - ■ / 

Traditionally, State agencies are accountable to the S^ate and local legislat/3rs 
* * ^ ■ * . ■ , / ' - , • 

' who authorize the fiunds to provide the education, the institutions, and the 
■ ' • ? ^ 1^ \* ' ' -N 

'^t^nchexs. As»a result of past legislatiofcff^the Federal (iove^tme^nt is another 

\ public. States are now accountable to the federal Government. This does' not 

contribute to improving your pro^aiif^ or enhancing ^the education your students 

receive. Indeed, ^most of wh^t Is termed accountability is required paperwork 

to show dbmpli^nce with complicated statutes and' tegulations. V{fejanticipate 

/ •/ ■ 

new legislation to significantly reduce , the accountability aijid compliance • 

aspects of Stated-Federal relational ) ' 
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■V ■• , ■ . ■ ,■; - : -■ , ' 

. . I- - ■. 

Vocational Education, now has additiiDnal .publics, beyond students and State 
/legislators to answer to.. Under the provisions of the recently enacted 
I Job Training Partnership Act, accountability-^or certain education and training 
responsibilities will be the responsibility of the governor and FICs — Private 
Industry Councils. * v * 

, J*riVate Industry Councils, inbartnership with the local government, have 
th^ responsibility to provide policy guidance and exercise oversight for 

\ •■' ' . ■ ■ ' ' ' • ; . ^■ 

job trMtfing activities in the^area. They ,^11 develop a job training plan. 

They will also reach agreement on howvthe plan will -be implemented, on the 

entity to administer the program, and on the grant recijJients for l^cal job ,\ 

• , training funds". The primary* consideration in selecting^ service ^rovid^ts 

will l^e demonstrated ef ffectiveness in delivering comparable services. y*Tl||i 

governor has to approv^e the plan and may*^also prescribe variations to tjaa^ 

\ \ ' ■ ^. J - ■ ' t ■ ' 

Department of -Labor established performance standards, )• If a local prqgram %, 

is not^atisf actory , the governor^ may impose ^ reorganization plan which.. 



may include the ^selection *pf an alternate entity, to admlnl^ster the pr^yam 



/ 



* for the servipe delivery area.'' o.. j y 

We should as vocational educators be accountable for taking advantage/ of the 
oppo^tupitles avail^iblle to Vyocational education under the^ Joi^t Training 
Partner ship Act.' , 

■ ' r:'. ■ ; ' • ■ , ' ., / 

(2) The second polfby statement from .thait publication I mentioned earlier is 
th'irfi a]/tliqugh , evaluation is «l national concern, "evaluation systems for vocational 
. educatfion will^" be the responsibility of State and local units to maximize the* 
vbcatlondr/educa^fion benefit to society." This concept, of States being ' 
rW^onsible/'fo^-olJferation^^^)8J^ decisioms for subjects which are of national . 
^;&ncern, is iy^^ey coinp^i\€»nt 'of this Administration'^ goals. 

.. '''* " h'^t' . ' . .h , 

ERIC •^>'. 6 , , . . 



When J spoke to the State,. Directors of Vocational Education,^ two years ago 

" ] \< ' ' ^ ^ . ^ ' . 

'(Snowbird, Utah, Septembj^ .21 , 1981), I spoke of the "Administration' s basic 
approach to . the delivery of educational services: who should govern and who 
shoulci "(Jeliver. Central to this approach is the retur^ of operational 
authority — and indeed, most judgement icalls— to the States and localities; 
to put it more bluntly,^ to phase out Federalv^ntrusion into day-to--day ^ 
educational matters and to redefine the Federal role as one of support and 
facilitation.'.' . ' ' * ^ 

This leads to the third policy statement from your Board: (3) planning arid 
implementation of vocational education programs shall be carried out by the 
local district i>ith the assistance of appropriate State leadersliip and Federal 




agencies. ^Wej at the Federal level^want to provide State 'and locAl agencies 



with assistance; Although we must, continue to fulfill our duties* in administering 
the' current Act, there are many wa'ys in which we plan ^o move from a ''compliance" 
role to one of "facilitation." Here are some examples of what my office is 



trying to do: ' ^ ^ ' ^ * ' ^ ^ 

— Provide. States with, the tjroRrammatic Support Services that will help to 
Str^ygthen Prof^ratns - In FY 19,82, approximately 7.5 milliort dollars;^ was 
appropriated for Programs of National Significance. The Prlpgrams of 
National Significance support the functions 'of applied studies, curriculum 
' development, demonstration, difiseminatidn, and training. This will include 
''not only our own on-site visits, as you may request them, but ensuring 
* that products from our National Center for Research in Vocational Education 
arid' from the. National Occupational tnf or^uU^ioV Coordinating Committee 
are' not only geared to your real needs, but are available to. you in a^ 
timely, efficient manner. We must develop a TJetter communication and 
diffusion system for your use, 

- -Provide National Coordination that will Expedite your Efforts to Address 
; National Skill Training Goals - This includes acting -as vocational education's 
*'in-hou8e" advocate with the Dopattment, other Federal agencles^vthe 
White House, arid the Congress* Also being your "point men" in riegotiot^ng 
agreements with other Federal^gencies such as the Department of^^DGfonse 
and. the Department of Labor^^nBo^as to ensure that vocational education has 
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a major role In their training programs, and overall, conducting the kind 
of effective, professional public relations effort that will educate all 
concerned regarding the contributions and benefits of your programs. 
. (This paragraph nnd preceeding paragraph taken from speech to State 
Directors at Snowbird, Utah, September 1981.) 

— Provide '^reate^ Emphasis to Pr6g^9JIl Improvement Activities - This Includes 
expanding OVAA's tophasis on prograb improvement; improving the relevance 

, of occupationalLly specific programs by more /^closely involving the private 
sector in their planning, operation, an* ev^uatlon; finding ^nd employing 
more effective means for ;Lmpr<5vlng programs in both urban centers and in 
sparsely populated rural areas} and incorporating emphasis on entrepreneur- 
ship education and on providing a skilled workforce ready to meet our 
defense needs in all vocational education programs. 

' Ij ^ 

We believe that our legislative proposal should provide the States as much 
flexibility as possible in deciding where to df^ct theiryPederal resources; 
The foVirth, and last, policy statement I would like to^xiomment on is "State 
agencies responsible for vocational education shall provide leadership 
for evaluation of vocational education programs, services, and activities." 

The State Board has also been, active in funding projects to evaluate vocational 

. * ^ ■ .. . ■ 

programs wlthlir^our State. Evaluating vbcntional^programs and measuring 
their effectiveness ,1s a very difficult ta^>k. Vocational programs have 
many different purposes covering a wide range, from ,career guidance through 
career exploration to high skills training for technology intensive industries. 
The array of institutions alone is extremely diverse: vocational high 
schools, Comprehensive high schools^, piubllc area vocational centers, , . 

private postsccondary institution^, cdnmiunlty colleges and technical 
institutes, State correctional ifocllltics, and correspondence 
schools. 
\ 



In my tcetimony to tl)^' ConmiiBSlon on Excellence, Denver, Colorado, September 
19^2 Hearings on ,Educotlon and Work, I said: 



There would seem to be four kinds of measures currently used to evaluate 

vacatlonal educa^tion: (1) coisponents and process; (2) Occupational' Impact; 

(3) equity; and (A) Individual student development. Each of these carrle^, 

^a' set of criteria/ based on specialized research, and accumulated over the 

years. For example, (1) ''components and process" criteria would include 

» 

* assessments of teacher qualifications, adequacy of shop facilities and 

equipment, and currency of curricul^um materials, together with the degree 
-tOv^hich proven instructional devices such as the ''project method" are ; 
being used. ^ 

(2) "Occupational impact" criteria would include placement rates, pay rates, 
and employei^evaluations, among others - in other words^ the type of analysis 
largely favored by the labor econpraiets for whom vocational education seems 
\ to have developed a special • fascination over the past decade. 



'^(3) "Equity" criteria are of more rccerft Qf^igin and have bcgn generated 
bV the civil rights movement that lod to four major plc^^H of Federal 
'legislation. It is more difficult to (jitc specific measures, in this 
case, except to say that for a significant numbcx; of persons who now 
"track" the \^ocational education enterprise, no program could be termed 
icxcellcrtt" %\\at docs not' have Boine percentage of women, mlnoritlcH, o- 
handicapped. ^ ^ y ^ 



'(4) ••Individual student development'' crlterlo - reflecting the "whole person 
concept pf oducotlon <- Include 6ucli nonoccupntlonnl monBurcn ns frequency 
of votltfg, involveniont In community offftirii, niul crlmtnul record, nmong 
iy otherB. This group of criteria rcmlndM urt ^tlmt while vocntlonnl 



education pl^^ys an important role in occupational skill training and -rotrainin^; 

It^is. also s^ecurely lodged within the overall education enterprise, 

^ ^ ■ ' 

. While it is not central to my discussion, I should point out that - in ^ ^ 

none of these measures - are we tai^ng about the simple \(.ir\d of precision 

that cttaracteVlzes those In the physical sciences- In-^a recent article, 

Dr. Charles Benison of the University of California at Berkeley, touches 

on some of these measurement problems. Regarding "occupational Impact 

criteria/' for instance/ he notes that, "If we wish to measure quality in 

terms of students' completions and placements, we must recognize that 

these data are very imperfectly reported. The same is"^ true of data on 

employers' opinions of quality of training received bv vocational grnduat-cs. 

Even if those kinds of data were widely available, it would be necessary 

to control for characteristics of entering students and for the state of . 

the local labor mnrket* Thus, the exercise is a complicated one." 

Extending Professor Bensoti's conmientn^ 1 would maintain that nil of tlie 
criteria 1 have Just sugp.ested for measuring; excellence prenrnt ,slml^nr 
compllcat iojis. 1^ would next ^ikv to share wTth \|()u what we percclvr to 
be two issues that, over the lonp run, will greatly affect vocational programs. 

V ■ 

Theti^ ore two qucotlono rtmon^ othcrn tlint wo nro pondering, toRctlicr wltli 
'a fcvf c^traneiitB: 

C. - ^ 

( 1) Ji?^l^^^ Rvnluntc our Progrnmn in^Sufflclont Sc ope nnd Dcptli m)^n^^ 
^^^.^l^Ay-J^^^ Tliltt in nctuAlly 

a two-^fold problem; flrwt, H Inyolvee renc^irch, .unporfo.rmcd to date, on 
how to achieve the weighting of the different evaluation mdn^urea for the 
ttuinyjllfferent voc^tionnl proB^*'*"^^} »eeond, given the reality that we 



have not done n comprehensive job of evaluating when we had*tnore funds 

for researcli and evaluation, how can vc ck^ the same job norc ef f ic iently <^ 

witl^ the few dollars now available (or' research and evaluation? 

) lii?^' ^'^LL'^^'^Jj^'^* decisions be nade , on aru* Levc l^ .regardinv^ ^'^V^^j^ 

Prograp should take precedence over others, when two or more rroy;rans are 
bjeing Considered? - Even giver^ l^c possibility that^we cnn correctly 
identify all^ needed improvements for all programs, it will be financially 
impossible to address all of these, simultaheously • How then do wc 
rationally choose between, two valid choices such as - let us say,- 
developing roorc effective cooperative programs for adults at the 
postsecondary level vorsvrs improving vocational guidance at the secondary 
level? are conducting serious discussions with State and loczil 

leadero on- these puitters and will, of course, appreciate whatever 
fAiggestionfi you may give us. 



A 



The rein t JutuililpM hi*lwern I h<; relate?- and the Kedcr;*!^ (\wrrntm?nt ^fr«* not 
one-way. Wc have a two-way relationjslvip. 1 feel very comrortable nr;kln^: ' 
you, and others, to contnuMU uju>n <jue:;tit^ns we fare and needs wc perceive. 
We, in Washington, axe depcndttnt upon you to help us, by sharing wlt!i 

V 

us yuur thoug'lits and ref li5Ctlonr4 upon key Ismucs. 

Let me discuss now our legislative proposal, . the Vocational nnd Adult Education 
Consolidation Act ot 1983 which consolidates existing vocational and adult 
programs into a alngle program of grants to the States, It will reduc;e 
administrative burden and increase State and local flexibility ovisr the 
use of funds. This ^»111 was introduced to the Senate by Senator Hatch on 
April 13 and in the ftouse on May 9 by Congressmen trlenborui Nielsen, 
Packard, and others* . 
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' .... 

The current Vocntlon.il Educfitlon Act Ir? a nnrc of r.ubprop.racLn, set ^J||pden» 

w 

and priorities, and in addition tP c^Jindat inp nctlvitifs and iU>als, included 

proci?!;.s rcqiiiret:icnLii for sub-€iutc alloc.'ition criteria. Our consolld.nt ion 
» » 

hill will be a K;reat ir:j^rovcrcnt over the oxistinf: lerJ !il«ti <^n. The ]^',uidlnj* 
principles in dc'velupinv,^»is bill wore: (1) to fUtrpUfy, increciGc flexibility^ 
and reduce pro^tam coHtr» at all level?* of governisent, and (2) to redirect 
Federal fiupport to focufi on thu role of vocational and adult edtica^tlon In 
economic development. Guided by thof^ prlnclplcK^ wc have fnfif»1oned a bill 
with the following components'. 

Part A» Cencj;^i Provisionn, In a dramatic ttltupllfication of the parnllel 
Bection of the current VtlA, At leant ninety^-fivc percent of all fvindn will 

biT nvide available to thC^Stateji ; up to 5 percent will be rcHcrved for national 

» 

proKratn in arearj of particular, nationwide Importance* A proponed uhc report, 
replacjlnp. the cxlntlnK. platui, evaluat Ions, and reportr,, wi 11 be r<'qu!red of , 
I'iuh Slate on ntxtui.il h.i?ih., Tht^ tiq^>t>»t will in* hide ^i nlmpl.r «?>;pianat ton 
oi piopotied objective!;, i^.ctlvllies (o be Mippmied, an<! nlhuntitni?! of fundr.* 
nf. well a.', other brfsic anfuirancer. .'ind <!eVirr ipt inns . Thr exlf-tltlf: VLA forntila 
ior State allotmentfi (bancd on population and Inven^e per capita Incope) Ir; 
'nK>|lfled to Ineltule an unemployment factor, tarnel more heavily ow older r 
^popuS^^ntt, i»nd eliminate coafitrn#||i km the Inromf* fucOiir. The exUtluR 
national advltiory counciln on adult mtd vocational education arc rcplaef?d by 
a single national advlwory councllt 

Tart \S of th<=,Act eoncernii St^te pfoRriima* A wtupj** conBnUtlat^»d Kt«nt le Wi^P 
to eftch LUnte. Tlie extftlng Vr^ eate^tonlea^ p^^^^B*'^^^ Propfatu Improvement, 
Consumer and Homemakin^ Kducatton, the DieadvdntaK^d, Stat^g riannhig» and .^t^t^P 
Advlaory Cj^nncilw ^re eliminated ^f^ th^ ^^t-anldee toi ^uliUiKr ^nd eoun^elinp, 
and the Bpetilfiil pdpul^^tlon groups. Also terminated ate the VfcA dctlvltlef^ 
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for . Immigrants, the Elderly , and Development and Dissemination as well as ; 

t{ie State set-aside for Special Experimental Demonstration Projects and 

Teacher. Training. Program matching, maintenance of effort, and most other' 

fiscal accountability requirements are eliminated. From their grants. States 

are required to use at least 30 percent of ^ the money for programs and' projects • 

spVcifically related to State and- local economical development." This is. the 
• ■ . , . » ' 

heart of the iiew^irectionVin Blis legislati^^ From these ^^funds, the States ^ 

would support- training needed for new businesses and industries or expanding 

old on their areas, retraining for skilled workers who have lost their jobs 

because of technological or ecDnOmiq changes, development o£; training prograins 

in new occupational, fields, and entreprenpurship training. In addition, 

the States are required tp use at ^Least 30.* percent of tW^^ funds^or strengthenin]^ 

State and local systems of vocational education. This requirement stems from 

a belief that improving the regular vocational educatioh program can have a 

payoff irf. future economic growth. Finally, at lea^t 13 percent of the State . 

grant is to be used for adult basic' education. This requirement will ei^ure 

that essential services to a very needy population^ are continued. 

^ ■ : 'f -4 . ■ 

■ * - ' ' ■ . ' • • '■ ' 

This, bill would require that States use at least 15^^ percent funds they 

receive und^ Subpart 2 (Strengthening State and Local Systems of Vocational 
Educktion) to meet the needs of the handicapped. It, also gives emphasis to 
sex equity activities, to retraining displaced workers, and to adult education 
services for the functionally illiterate. 

Although this bill is q'^ite similar to the Administration's proposed bill last 
year, there are some significant differences. Among' them are: 
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set' aside (15%) for the handicapped ; • 
--Added emphasis on sex equity provisions and activities 
The ceiling on State administrativ'e -costs was eliminated 

% ^ ' ' ■ ■ ' ■• "• ■ w 

It has been a- privilege to speak with you tod^y about o\xr common cortperns 
and how; we hope to improve the practice of State and Federal administration 
'of voe^tional education. If there are any questions, I would be happy to 
respond to them. ' 
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